Image processing device

ABSTRACT

An image processing device includes a specific color specification unit  2  for acquiring RGB color component data about specific colors a and b from a display image  5  by using a mark for specific color specification, a specific color information conversion unit  3  for determining values H respectively corresponding to the hues of the specific colors a and b from an RGB color space by using the RGB color component data about the specific colors a and b, and a color conversion unit  4  for color-converting the specific color a in the display image  5  into the specific color b according to the values respectively corresponding to the hues of the specific colors a and b.

FIELD OF THE INVENTION

The present invention relates to an image processing device thatgenerates a special image from an inputted image.

BACKGROUND OF THE INVENTION

For example, patent reference 1 discloses an image processing devicethat performs a special effect process on an inputted image to generatea special image. The special effect process performed by this imageprocessing device includes a process of specifying a specific color fromthe inputted image to display an image in which the color of any areaother than areas colored in this specific color is black or white, and aprocess of displaying an image in which a specific color (a color A) isreplaced by another specific color (a color B). By using the specialeffect process of generating an image in which the color of any areaother than a partial area colored in a specific color is black or white,e.g. an image of a female's face in which only the color of her lip ismaintained and the other colors are replaced by gray so that the partialarea is emphasized in the image can be acquired.

[Patent reference 1]

JP, 2004-7370,A

In conventional image processing devices, an operation regarding specialeffect processing is complicated, and a GUI (Graphical User Interface)used for carrying out this operation and intended for a computer havinga relatively large display screen is disposed. For example, conventionalimage processing software can carry out various types of special effectprocessings when it is executed by a computer, though it cannot generatea desired image unless it is handled by a skilled operator because it isrelatively difficult to perform an operation of selecting a specialeffect, setting up the descriptions of the special effect processing,and so on.

Furthermore, in the image processing device disclosed by patentreference 1, on a relatively large display screen on which an inputtedimage yet to be processed and a special image processed are separatelydisplayed at the same time, and a window showing the descriptions of theuser's operation can be displayed, the user is allowed to specify aspecific color from the inputted image by using a pointing device suchas a mouse.

Thus, conventional image processing devices perform special effectprocessing and so on via a user interface which adapts to a relativelylarge display screen. Therefore, a device having a small display screensuch as a mobile phone or a digital still camera (referred to as a DSCfrom here on when required) cannot display a user interface intended forconventional image processing devices on the screen thereof because theuser interface is too large.

Furthermore, a mobile phone and a DSC have small input devices, such askey buttons and a jog dial, and both the input devices and the displayscreen are disposed on the same outer surface of the housing in order toreduce the area occupied by the small input devices. Such an inputdevice is unsuitable for a complicated operation requiring mouse and keyoperations heavily.

In addition, conventional image processing devices including the imageprocessing device disclosed by patent reference 1 calculate a hue whichis a color variable in a special effect processing by usingtrigonometric functions. For example, after converting R (red), G(green) and B (blue) (described as RGB from here on when required) ofthe inputted image into an XYZ color space, calculating powers andconverting the XYZ color space into a Lab uniform color space, theconventional image processing devices convert the Lab uniform colorspace into a hue H by performing a complicated arithmetic operation,such as calculations using a trigonometric function (H=atanθ or H=atan(a,b)).

Thus, the conventional image processing devices have a large arithmeticload of the image processing. A problem is therefore that in order tospeed up the image processing, a large-scale hardware configurationhaving a combination of many computing units is required, and it istherefore difficult to implement a small-sized high-speed imageprocessing device.

The present invention is made in order to solve the above-mentionedproblems, and it is therefore an object of the present invention toprovide an image processing device that can generate a special image ata high speed through a simple input operation.

DISCLOSURE OF THE INVENTION

In accordance with the present invention, there is provided an imageprocessing device including: a specific color specification unit foracquiring, as color component data about first and second specificcolors, color component data of at least one set of image areas whichare selected from an image, which is a target for processing, by using amark for specific color specification which is displayed on a displayscreen in synchronization with an input operation using an input deviceand which moves on the image which is the target for processing; aspecific color information conversion unit for determining valuesrespectively corresponding to hues of the first and second specificcolors from a color space having hue components by using the colorcomponent data about the first and second specific colors acquired bythe specific color specification unit; and a color conversion unit forcolor-converting the first specific color in the image which is thetarget for processing into the second specific color according to thevalues respectively corresponding to the hues of the first and secondspecific colors which are determined by the specific color informationconversion unit. Because the image processing device is configured inthis way, the image processing device provides an advantage of beingable to generate a special image which meets a user's needs at a highspeed through a simple input operation.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 is a block diagram showing the configuration of an imageprocessing device in accordance with Embodiment 1 of the presentinvention;

FIG. 2 is a view for explaining an operation of specifying a specificcolor;

FIG. 3 is a block diagram showing the configuration of an imageprocessing device in accordance with Embodiment 2 of the presentinvention;

FIG. 4 is a view showing a color bar which an image processing device inaccordance with Embodiment 3 of the present invention uses forspecification of a specific color;

FIG. 5 is a view showing a gradation color bar which an image processingdevice in accordance with Embodiment 4 of the present invention uses forspecification of a specific color;

FIG. 6 is a view showing another example of the gradation color barwhich the image processing device in accordance with Embodiment 4 of thepresent invention uses for specification of a specific color;

FIG. 7 is a view showing a gradation color circle which the imageprocessing device in accordance with Embodiment 4 of the presentinvention uses for specification of a specific color;

FIG. 8 is a block diagram showing the configuration of an imageprocessing device in accordance with Embodiment 5 of the presentinvention;

FIG. 9 is a view for explaining a process of specifying a specific colorwhich is carried out by the image processing device shown in FIG. 8; and

FIG. 10 is a view for explaining another example of the process ofspecifying a specific color which is carried out by the image processingdevice shown in FIG. 8.

PREFERRED EMBODIMENTS OF THE INVENTION

Hereafter, in order to explain this invention in greater detail, thepreferred embodiments of the present invention will be described withreference to the accompanying drawings.

EMBODIMENT 1

FIG. 1 is a block diagram showing the configuration of an imageprocessing device in accordance with Embodiment 1 of the presentinvention. In FIG. 1, the image processing device 1 in accordance withEmbodiment 1 color-converts a specific color a (a first specific color)into a specific color b (a second specific color) in an image shown by afirst image signal inputted thereto. In this case, the first imagesignal consists of RGB signals, and shows image data about an imagewhich is displayed on the display screen of a display device (not shown)which the image processing device 1 has. A second image signal showsimage data about an image in which the specific color a iscolor-converted into the specific color b in the image shown by thefirst image signal.

The image processing device 1 in accordance with Embodiment 1 isprovided with a specific color specification unit 2, a specific colorinformation conversion unit 3, and a color conversion unit 4. Thespecific color specification unit 2 is a component for specifying aspecific color required for color conversion from the image shown by thefirst image signal, and provides a GUI for specifying a specific colorfrom the image shown by the first image signal in synchronization with auser's input operation using a not-shown input device.

The specific color information conversion unit 3 converts colorcomponent data about each specific color specified by the specific colorspecification unit 2 into color conversion information applicable to thecolor conversion process. As this color conversion information, forexample, there is a numerical value corresponding to a hue which iscalculated from an RGB space by using an RGB ratio corresponding to theRGB data about the specific color. The color conversion informationdiffers dependently upon a color conversion method which is executed bythe color conversion unit 4. For example, when the color conversion unit4 carries out the color conversion in an YCbCr color space or an L*a*b*color space, a numerical value corresponding to a hue defined in theYCbCr color space or the L*a*b* color space is provided as the colorconversion information.

The color conversion unit 4 color-converts the image shown by the firstimage signal by using the color conversion information about eachspecific color determined by the specific color information conversionunit 3 to output, as the color-converted image, a second image signal.As the color conversion method, for example, a method of simplyspecifying a hue of a specific color to be color-converted, andcolor-converting the hue of the specific color to a hue of anotherspecific color to which the specific color is to be color-converted canbe used. Furthermore, the color conversion unit can carry out the colorconversion in a color space, such as an RGB color space, an YCbCr colorspace, or an L*a*b* color space.

The above-mentioned specific color specification unit 2, theabove-mentioned specific color information conversion unit 3, and theabove-mentioned color conversion unit 4 can be implemented as a concretemeans in which software and hardware operate in corporation with eachother by causing a computer to execute an image processing programaccording to the scope of the present invention, and then controllingthe operation of the computer.

Next, the operation of the image processing device will be explained.

Hereinafter, a case in which the image processing device 1 in accordancewith Embodiment 1 is embodied by making a processor of a mobileinformation terminal having a small display device execute theabove-mentioned image processing program will be mentioned as anexample. A mobile phone or a DSC can be provided as the above-mentionedmobile information terminal, though the present invention is not limitedto this example. For example, the mobile information terminal can be adevice which is classified as PDA (Personal Digital Assistants).

First, the specific color specification unit 2 of the image processingdevice 1 displays the image shown by the first image signal which is thetarget for image processing on the display screen of the above-mentioneddisplay device. FIG. 2 is a view for explaining an operation ofspecifying a specific color, and a display image 5 is the image shown bythe first image signal displayed on the above-mentioned display screen.In this case, a user specifies a specific color from the display image 5on the above-mentioned display screen by using a not-shown input devicewhich the above-mentioned mobile information terminal has.

In the example shown in FIG. 2, a case in which by using the not-showninput device, the user marks, as a partial area colored in the specificcolor a on which the color conversion is to be performed, a part of theroof of the house shown in the display image 5, and also marks, as apartial area colored in the specific color b which is the color intowhich the specific color a is to be color-converted, a part of the skyshown in the display image 5 is shown. The marking can be displayed inthe display image 5 in synchronization with the user's input operationon the above-mentioned input device. In FIG. 2, the partial area coloredin each of the specific colors is expressed by a rectangular mark.

When a part of the image is marked, as a partial area colored in each ofthe specific colors, on the display image 5 by the user in theabove-mentioned way, the specific color specification unit 2 acquiresRGB data in the above-mentioned partial area as RGB data about each ofthe specific colors specified by the user. Because each marked part is aminute area consisting of two or more pixels, the specific colorspecification unit 2 calculates an RGB average value of the pixels inthis area to acquire the RGB data about the specific color in eachmarked part. For example, when one marked part is an area having npixels in a vertical direction and m pixels in a horizontal direction (nand m are positive integers), the specific color specification unit 2calculates the RGB average value of the n×m pixels as the RGB value ofthe specific color in the marked part.

After acquiring the RGB data about the specific colors a and b from thespecific color specification unit 2, the specific color informationconversion unit 3 calculates both a numerical value corresponding to thehue of the specific color a and a numerical value corresponding to thehue of the specific color b from the RGB data about the specific colorsa and b, and outputs these numerical values to the color conversion unit4 as the color conversion information required for the color conversionby the color conversion unit 4. In this case, the specific colorinformation conversion unit calculates a numerical value H correspondingto each of the hues from the RGB ratio in the RGB color space.

For example, when each RGB data has a value ranging from 0 to 255, theRGB ratio HP of a specific color is shown by the following equation (1).Then, according to the following creation of cases of the RGB ratio HP,a color area in the RGB color space is specified and a numerical value Hcorresponding to the hue is calculated.

HP=(max(R,G,B)−min(R,G,B))×255/(max(R,G,B)−min(R,G,B))  (1)

At the time of 0<HP≦255 (red to yellow) H=HP

At the time of 255<HP≦255×2 (yellow to green) H=255×2−HP

At the time of 255×2<HP≦255×3 (green to cyan) H=255×2+HP

At the time of 255×3<HP≦255×4 (cyan to blue) H=255×4−HP

At the time of 255×4<HP≦255×5 (blue to magenta) H=255×4+HP

At the time of 255×5<HP≦255×6 (magenta to red) H=255×6−HP

Thus, the image processing device 1 in accordance with Embodiment 1calculates a numerical value H corresponding to the hue of each specificcolor according to the RGB ratio of each specific color in the RGB colorspace. Therefore, the specific color information conversion unit 3carries out an arithmetic operation excluding multiplications andcomplicated arithmetic operations using trigonometric functions, unlikeconventional image processing devices, but including only the singledivider for determining the RGB ratio HP and the conditional branchesfor the RGB ratio HP. Therefore, the load of the arithmetic operation ofcalculating a numerical value corresponding to the hue of each specificcolor can be reduced.

In the above-mentioned explanation, the case in which a numerical valueH corresponding to the hue of each specific color is calculated from theRGB ratio of each specific color in the RGB color space is shown.However, the present embodiment is not limited to this example. Forexample, the specific color information conversion unit 3 can convertthe RGB data about the specific colors a and b into YCbCr data as thecolor conversion information, and calculate a numerical valuecorresponding to the hue of each of the specific colors from the YCbCrratio of each of the specific colors in the YCbCr color space. As analternative, the specific color information conversion unit can convertthe RGB data about the specific colors a and b into L*a*b* data as thecolor conversion information, and calculate a numerical valuecorresponding to the hue of each of the specific colors in the L*a*b*color space.

The color conversion unit 4 performs color conversion on the image shownby the first image signal according to the color conversion informationdetermined by the specific color information conversion unit 3, andoutputs a second image signal as the color-converted image. In theexample of FIG. 2, an image in which the specific color a iscolor-converted into the specific color b in the display image 5 shownby the first image signal is generated, and a second image signal isoutputted, as the image, to the display device.

As mentioned above, the image processing device in accordance with thisEmbodiment 1 includes the specific color specification unit 2 foracquiring, as RGB color component data about specific colors a and b,RGB component data of at least one set of image areas which are selectedfrom a display image 5 by using a mark for specific color specificationwhich can move on the display image 5, the specific color informationconversion unit 3 for determining numerical values H respectivelycorresponding to the hues of the specific colors a and b from an RGBcolor space having hue components by using the RGB color component dataabout the specific colors a and b acquired by the specific colorspecification unit 2, and the color conversion unit 4 forcolor-converting the specific color a in the display image 5 into thespecific color b according to the numerical values respectivelycorresponding to the hues of the specific colors a and b, which aredetermined by the specific color information conversion unit 3.Accordingly, since the image processing device in accordance with thisEmbodiment 1 enables the user to specify the specific colors a and b inthe display image 5, the user does not have to perform a complicatedoperation requiring mouse and key operations heavily, and therefore canspecify the specific colors by performing a simple input operation.Furthermore, because the image processing device in accordance with thisEmbodiment 1 calculates the numerical values H respectivelycorresponding to the hues of the specific colors a and b from the RGBcolor space having hue components by using the color component dataabout the specific colors a and b, the image processing device cancalculate, as the color conversion information, the numerical valuesrespectively corresponding to the hues of the specific colors byperforming a simple arithmetic operation including a division andconditional branches, the image processing device can remarkably reducethe arithmetic load as compared with conventional image processingdevices. Accordingly, the image processing device can generate a specialimage in which the specific color a is color-converted into the specificcolor b at a high speed.

In above-mentioned Embodiment 1, the case in which only the set ofspecific colors a and b are specified and then the specific color a iscolor-converted into the specific color b is explained, though two ormore sets of a specific color to be color-converted and another specificcolor to which the specific color is to be color-converted can bespecified. In this case, the specific color information conversion unit3 calculates numerical values corresponding to the hues of the specificcolors in each set in such a way that a hue area shown by a numericalvalue corresponding to the hue derived from the data about the specificcolor to be color-converted in each set does not overlap a hue areashown by a numerical value corresponding to the hue derived from thedata about the specific color to be color-converted in any other set, soas to set up a hue area corresponding to the specific color to becolor-converted in each set.

Embodiment 2

FIG. 3 is a block diagram showing the configuration of an imageprocessing device in accordance with Embodiment 2 of the presentinvention. In FIG. 3, the image processing device 1A in accordance withEmbodiment 2 performs exclusive color conversion on the color of anyarea other than areas colored in a specific color a which is specifiedfor an image shown by a first image signal inputted thereto to convertthe color into black or white. In this case, the first image signalconsists of RGB signals, and shows image data about an image which isdisplayed on the display screen of a display device (not shown) whichthe image processing device 1 has. A second image signal is image datain which exclusive color conversion is performed on the color of anyarea other than areas colored in the specific color a which is specifiedfor the image shown by the first image signal to convert the color intoblack or white.

The image processing device 1A in accordance with Embodiment 2 isprovided with a specific color specification unit 2, a specific colorinformation conversion unit 3, and an exclusive color conversion unit 6.The specific color specification unit 2 is a component for specifying aspecific color required for the color conversion from the image shown bythe first image signal, and provides a GUI for specifying a specificcolor from the image shown by the first image signal in synchronizationwith a user's input operation using a not-shown input device.

The specific color information conversion unit 3 converts the data aboutthe specific color specified by the specific color specification unit 2and preset black and white levels into color conversion informationapplicable to the exclusive color conversion process. As this colorconversion information, for example, there is a numerical valuecorresponding to a hue which is calculated from an RGB space by using anRGB ratio corresponding to the RGB data about the specific color. Thecolor conversion information differs dependently upon an exclusive colorconversion method which is executed by the exclusive color conversionunit 6. For example, when the exclusive color conversion unit 6 carriesout the exclusive color conversion in an YCbCr color space or an L*a*b*color space, a numerical value corresponding to a hue defined in theYCbCr color space or the L*a*b* color space is provided as the colorconversion information.

The exclusive color conversion unit 6 performs the exclusive colorconversion on the image shown by the first image signal by using thecolor conversion information about the specific color determined by thespecific color information conversion unit 3 to output, as theexclusive-color-converted image, a second image signal. Furthermore, theexclusive color conversion unit can carry out the exclusive colorconversion in a color space, such as an RGB color space, an YCbCr colorspace, or an L*a*b* color space.

The above-mentioned specific color specification unit 2, theabove-mentioned specific color information conversion unit 3, and theabove-mentioned exclusive color conversion unit 6 can be implemented asa concrete means in which software and hardware operate in corporationwith each other by causing a computer to execute an image processingprogram according to the scope of the present invention, and thencontrolling the operation of the computer.

Next, the operation of the image processing device will be explained.

Hereinafter, a case in which the image processing device 1A inaccordance with Embodiment 2 is embodied by making a processor of amobile information terminal having a small display device execute theabove-mentioned image processing program will be mentioned as anexample. A mobile phone or a DSC can be provided as the above-mentionedmobile information terminal, though the present invention is not limitedto this example. For example, the mobile information terminal can be adevice which is classified as PDA (Personal Digital Assistants).

First, the specific color specification unit 2 of the image processingdevice 1A displays the image shown by the first image signal which isthe target for image processing on the display screen of theabove-mentioned display device. In this case, a user specifies aspecific color from the display image on the above-mentioned displayscreen by using the not-shown input device which the above-mentionedmobile information terminal has.

An explanation will be made with reference to FIG. 2 shown inabove-mentioned Embodiment 1. In the example shown in FIG. 2, by usingthe not-shown input device, the user marks, as a partial area of aspecific color a on which no exclusive color conversion is to beperformed (a partial area in which the specific color is notexclusive-color-converted into block or white), for example, a part ofthe roof of the house shown in the display image 5. The marking can bedisplayed, as a rectangular mark, in the display image 5 insynchronization with the user's input operation on the above-mentionedinput device, like in the case of above-mentioned Embodiment 1.

When a part of the image is marked, as a partial area of the specificcolor, on the display image 5 by the user in the above-mentioned way,the specific color specification unit 2 acquires RGB data in theabove-mentioned partial area as RGB data about the specific colorspecified by the user. Like in the case of above-mentioned Embodiment 1,because the marked part is a minute area consisting of two or morepixels, the specific color specification unit 2 calculates an RGBaverage value of the pixels in this area to acquire the RGB data aboutthe specific color in the marked part.

After acquiring the RGB data about the specific color a on which noexclusive color conversion is to be performed from the specific colorspecification unit 2, the specific color information conversion unit 3calculates a numerical value corresponding to the hue of the specificcolor a in the same way as that shown in above-mentioned Embodiment 1.After that, the specific color information conversion unit 3 outputs thenumerical value corresponding to the hue of the specific color a onwhich no exclusive color conversion is to be performed, and preset blackand white level data to the exclusive color conversion unit 6 as thecolor conversion information. In this case, the specific colorinformation conversion unit calculates a numerical value H correspondingto the hue from an RGB ratio in the RGB color space.

The exclusive color conversion unit 6 performs the exclusive colorconversion on the image shown by the first image signal according to thecolor conversion information determined by the specific colorinformation conversion unit 3, and outputs a second image signal as theexclusive-color-converted image. In the example of FIG. 2, an image inwhich the color of any area other than areas colored in the specificcolor a is exclusive-color-converted into black or white in the displayimage 5 shown by the first image signal is generated, and a second imagesignal is outputted, as the exclusive-color-converted image, to thedisplay device.

As mentioned above, the image processing device in accordance with thisEmbodiment 2 includes the specific color specification unit 2 foracquiring, as RGB color component data about a specific color a, RGBcomponent data of at least one image area which is selected from adisplay image 5 by using a mark for specific color specification whichcan move on the display image 5, the specific color informationconversion unit 3 for determining a numerical value H corresponding tothe hue of the specific color a from an RGB color space having huecomponents by using the RGB color component data about the specificcolor a acquired by the specific color specification unit 2, and theexclusive color conversion unit 6 for color-converting any color otherthan the specific color a in the display image 5 into black or whiteaccording to the numerical value corresponding to the hue of thespecific color a, which is determined by the specific color informationconversion unit 3. Accordingly, since the image processing device inaccordance with this Embodiment 2 enables the user to specify thespecific color a in the display image 5, the user does not have toperform a complicated operation requiring mouse and key operationsheavily, and therefore can specify the specific color by performing asimple input operation. Furthermore, because the image processing devicein accordance with this Embodiment 2 calculates a numerical value Hcorresponding to the hue of the specific color a from the RGB colorspace having hue components by using the color component data about thespecific color a, the image processing device can calculate, as thecolor conversion information, the numerical value corresponding to thehue of the specific color by performing a simple arithmetic operationincluding a division and conditional branches, and remarkably reduce thearithmetic load as compared with conventional image processing devices,like in the case of above-mentioned Embodiment 1. Accordingly, the imageprocessing device can generate a special image in which the imageprocessing device has exclusive-color-converted the color of any areaother than areas colored in the specific color a into black or white ata high speed.

In above-mentioned Embodiment 2, the case in which only one specificcolor is specified and the exclusive color conversion is then performedis explained, though two or more specific colors on which on exclusivecolor conversion into black or white is to be performed can bespecified. In this case, the specific color information conversion unit3 calculates a numerical value corresponding to the hue of each of thespecific colors in such a way that a hue area shown by a numerical valuecorresponding to the hue derived from the data about each of thespecific colors does not overlap a hue area shown by a numerical valuecorresponding to the hue derived from the data about any other specificcolor, so as to set up a hue area corresponding to each of the specificcolors.

Embodiment 3

In above-mentioned Embodiments 1 and 2, the configuration for specifyinga specific color from an image shown by a first image signal anddisplayed on a display device is shown. An image processing device inaccordance with this Embodiment 3 has the same basic configuration asthat in accordance with above-mentioned Embodiment 1 or 2, while theimage processing device in accordance with this Embodiment 3 differsfrom that in accordance with above-mentioned Embodiment 1 or 2 in thatit specifies a specific color from a color bar superimposed anddisplayed on an image shown by a first image signal in a process ofspecifying a specific color using a specific color specification unit.

FIG. 4 is a view showing the color bar which the image processing devicein accordance with Embodiment 3 of the present invention uses for thespecification of a specific color. The color bar 7 includes hues whichare arranged in order according to an HSV hue circle in a rectangularframe. Although the color bar 7 is described in black and white in FIG.4 by the rules for the creation of filing patent application documents,red, apricot, yellow, yellowish green, green, bluish green, blue, bluishpurple, purple, and reddish purple are actually arranged in order from aleft-hand side to a right-hand side of the color bar 7.

The specific color specification unit 2 in accordance with Embodiment 3displays an image shown by a first image signal which is the target forimage processing on the display screen of a display device whilesuperimposing the color bar 7 on the image. A user specifies a specificcolor from the above-mentioned color bar 7 on the display screen byusing a not-shown input device.

In the example shown in FIG. 4, the user marks, as an area of a specificcolor a on which color conversion is to be performed, a left end part (ared area) of the color bar 7 by using the not-shown input device, andalso marks, as an area of a specific color b to which the specific colora is to be color-converted, a central part (a blue area) of the colorbar 7. The marking can be displayed in the color bar 7 insynchronization with the user's input operation on the above-mentionedinput device. In FIG. 4, the area of each of the specific colors isexpressed by a rectangular mark.

When a partial area of the color bar 7 is marked, as an area of each ofthe specific colors, by the user in the above-mentioned way, thespecific color specification unit 2 acquires RGB data in theabove-mentioned partial area as RGB data about each of the specificcolors specified by the user. Because each marked part is a minute areaconsisting of two or more pixels, the specific color specification unit2 calculates an RGB average value of the pixels in this area to acquirethe RGB data about the specific color in each marked part. For example,when one marked part is an area having n pixels in a vertical directionand m pixels in a horizontal direction (n and m are positive integers),the specific color specification unit 2 calculates the RGB average valueof the n×m pixels as the RGB value of the specific color in the markedpart.

After acquiring the RGB data about the specific colors a and b from thespecific color specification unit 2, the specific color informationconversion unit 3 calculates both a numerical value corresponding to thehue of the specific color a and a numerical value corresponding to thehue of the specific color b from the RGB data about the specific colorsa and b, and outputs these numerical values to the color conversion unit4 as color conversion information required for the color conversion bythe color conversion unit 4. In this case, the specific colorinformation conversion unit calculates a numerical value H correspondingto each of the hues from an RGB ratio in the RGB color space.

The color conversion unit 4 performs the color conversion on the imageshown by the first image signal according to the color conversioninformation determined by the specific color information conversion unit3, and then outputs a second image signal as the color-converted image.As a result, an image in which the specific color a is color-convertedinto the specific color b in the image shown by the first image signalis generated, and a second image signal is outputted, as thecolor-converted image, to the display device.

As mentioned above, because the image processing device in accordancewith this Embodiment 3 displays a color bar 7 including hues which arearranged in order according to a hue circle while superimposing thecolor bar 7 on an image which is the target for processing, and enablesthe user to select specific colors from this color bar 7, the user caneasily recognize the hue of each of the specific colors visually, andcan also select each of the specific colors by simply marking acorresponding area.

In above-mentioned Embodiment 3, the case in which the image processingdevice color-converts a specific color a to a specific color b as in thecase of above-mentioned Embodiment 1 is shown. As an alternative, thecolor bar 7 in accordance with above-mentioned Embodiment 3 can beapplied to the configuration in accordance with above-mentionedEmbodiment 2, and the image processing device canexclusive-color-convert the color of any area other than areas coloredin a specific color a specified from the color bar 7 into black orwhite.

Embodiment 4

In above-mentioned Embodiment 3, the configuration of specifying aspecific color from a color bar in which hues are arranged in orderaccording to a hue circle is shown. An image processing device inaccordance with this Embodiment 4 has the same basic configuration asthat in accordance with above-mentioned Embodiment 1, 2 or 3, while theimage processing device in accordance with this Embodiment 4 differsfrom that in accordance with above-mentioned Embodiment 1, 2 or 3 inthat it specifies a specific color from a gradation color bar or agradation color circle superimposed and displayed on an image shown by afirst image signal in a process of specifying a specific color using aspecific color specification unit.

FIG. 5 is a view showing the gradation color bar which the imageprocessing device in accordance with Embodiment 4 of the presentinvention uses for the specification of a specific color. The gradationcolor bar 8 includes hues which are arranged in a horizontal directionin a rectangular frame and in order according to an HSV hue circle withtheir brightnesses being varied gradually along a vertical direction inthe above-mentioned rectangular frame. Although the gradation color bar8 is described in black and white in FIG. 5 by the rules for thecreation of filing patent application documents, red, apricot, yellow,yellowish green, green, bluish green, blue, bluish purple, purple, andreddish purple are actually arranged in order from a left-hand side to aright-hand side of the gradation color bar 8, and their brightnesses areincreased gradually along a vertical direction from a lower side to anupper side.

FIG. 6 is a view showing another example of the gradation color barwhich the image processing device in accordance with Embodiment 4 usesfor the specification of a specific color. The gradation color bar 9includes hues which are arranged in a horizontal direction in arectangular frame and in order according to an HSV hue circle with theircolor saturations being varied gradually along a vertical direction inthe above-mentioned rectangular frame. Although the gradation color bar9 is described in black and white in FIG. 6 by the rules for thecreation of filing patent application documents, red, apricot, yellow,yellowish green, green, bluish green, blue, bluish purple, purple, andreddish purple are actually arranged in order from a left-hand side to aright-hand side of the gradation color bar 9, and their colorsaturations are increased gradually along a vertical direction from alower side to an upper side.

FIG. 7 is a view showing the gradation color circle which the imageprocessing device in accordance with Embodiment 4 uses for thespecification of a specific color. The gradation color circle 10includes hues which are arranged in the form of a circle and in orderaccording to an HSV hue circle in a circular frame with their colorsaturations being varied gradually along a direction from the center ofthe above-mentioned circular frame toward the outer edge of the circularframe. Although the gradation color circle 10 is described in black andwhite in FIG. 7 by the rules for the creation of filing patentapplication documents, red, apricot, yellow, yellowish green, green,bluish green, blue, bluish purple, purple, and reddish purple areactually arranged in the form of a circle and in order, and their colorsaturations are increased gradually along the direction from the centerof the circular frame toward the outer edge of the circular frame.

The specific color specification unit 2 in accordance with Embodiment 4displays an image shown by a first image signal which is the target forimage processing on the display screen of a display device whilesuperimposing the gradation color bar 8 (the gradation color bar 9 orthe gradation color circle 10) on the image. A user specifies a specificcolor from the above-mentioned gradation color bar 8 (the gradationcolor bar 9 or the gradation color circle 10) on the display screen byusing a not-shown input device.

In the example shown in FIG. 5, a case in which the user marks, as anarea of a specific color a on which the color conversion is to beperformed, an area (a red area with an intermediate brightness) at aleft end and at a middle vertical position of the gradation color bar 8by using the not-shown input device, and also marks, as an area of aspecific color b to which the specific color a is to be color-converted,a central area (a blue area) at a middle vertical position of thegradation color bar 8 is shown. The marking can be displayed in thegradation color bar 8 in synchronization with the user's input operationon the above-mentioned input device. In FIG. 5, the area of each of thespecific colors is expressed by a rectangular mark.

In the example shown in FIG. 6, a case in which the user marks, as anarea of a specific color a on which the color conversion is to beperformed, an area (a red area with a color saturation higher than anintermediate one) at a left end and at an upper vertical position of thegradation color bar 9 by using the not-shown input device, and alsomarks, as an area of a specific color b to which the specific color a isto be color-converted, a central area (a blue area with a colorsaturation higher than an intermediate one) at an upper verticalposition of the gradation color bar 8 is shown. The marking can bedisplayed in the gradation color bar 8 in synchronization with theuser's input operation on the above-mentioned input device. In FIG. 6,the area of each of the specific colors is expressed by a rectangularmark.

In the example shown in FIG. 7, a case in which the user marks, as anarea of a specific color a on which the color conversion is to beperformed, an outer edge area (an area with a maximum color saturation)in which a red color is placed in the gradation color circle 10 by usingthe not-shown input device, and also marks, as an area of a specificcolor b to which the specific color a is to be color-converted, a middlearea (an area with an intermediate color saturation) in which a bluecolor is placed between the center and the outer edge of the gradationcolor circle 10 is shown. The marking can be displayed in the gradationcolor circle 10 in synchronization with the user's input operation onthe above-mentioned input device. In FIG. 7, the area of each of thespecific colors is expressed by a rectangular mark.

When a partial area of the gradation color bar 8 (the gradation colorbar 9 or the gradation color circle 10) is marked, as an area of each ofthe specific colors, by the user in the above-mentioned way, thespecific color specification unit 2 acquires RGB data in theabove-mentioned partial area as RGB data about each of the specificcolors specified by the user. Because each marked part is a minute areaconsisting of two or more pixels, the specific color specification unit2 calculates an RGB average value of the pixels in this area to acquirethe RGB data about the specific color in each marked part. For example,when one marked part is an area having n pixels in a vertical directionand m pixels in a horizontal direction (n and m are positive integers),the specific color specification unit 2 calculates the RGB average valueof the n×m pixels as the RGB value of the specific color in the markedpart.

After acquiring the RGB data about the specific colors a and b from thespecific color specification unit 2, the specific color informationconversion unit 3 calculates both a numerical value corresponding to thehue of the specific color a and a numerical value corresponding to thehue of the specific color b from the RGB data about the specific colorsa and b, and outputs these numerical values to the color conversion unit4 as the color conversion information required for the color conversionby the color conversion unit 4. In this case, the specific colorinformation conversion unit calculates a numerical value H correspondingto each of the hues from an RGB ratio in the RGB color space.

The color conversion unit 4 performs the color conversion on the imageshown by the first image signal according to the color conversioninformation determined by the specific color information conversion unit3, and then outputs a second image signal as the color-converted image.As a result, an image in which the specific color a is color-convertedinto the specific color b in the image shown by the first image signalis generated, and a second image signal is outputted, as thecolor-converted image, to the display device.

As mentioned above, because the image processing device in accordancewith this Embodiment 4 displays at least one of a gradation color bar 8including hues which are arranged in a horizontal direction in arectangular frame and in order according to a hue circle with theirbrightnesses being varied gradually along a vertical direction in therectangular frame, a gradation color bar 9 including hues which arearranged in a horizontal direction in a rectangular frame and in orderaccording to a hue circle with their color saturations being variedgradually along a vertical direction in the rectangular frame, and agradation color circle 10 including hues which are arranged in the formof a circle in a circular frame and in order according to a hue circlewith their color saturations being varied gradually along a directionfrom the center of the circular frame toward the outer edge of thecircular frame, while superimposing the gradation color bar 8, thegradation color bar 9 or the gradation color circle 10 on an image whichis the target for processing, and enables the user to select a specificcolor from the gradation color bar 8 (the gradation color bar 9 or thegradation color circle 10), the user can easily recognize the hue andbrightness or color saturation of a specific color visually, and canalso select a specific color by simply marking a corresponding area.

In above-mentioned Embodiment 4, the case in which the image processingdevice color-converts a specific color a to a specific color b as in thecase of above-mentioned Embodiment 1 is shown. As an alternative, thegradation color bar 8 (the gradation color bar 9 or the gradation colorcircle 10) in accordance with above-mentioned Embodiment 4 can beapplied to the configuration in accordance with above-mentionedEmbodiment 2, and the image processing device canexclusive-color-convert the color of any area other than areas coloredin a specific color a specified from the gradation color bar 8 (thegradation color bar 9 or the gradation color circle 10) into black orwhite.

Embodiment 5

FIG. 8 is a block diagram showing the configuration of an imageprocessing device in accordance with Embodiment 5 of the presentinvention. In FIG. 8, the image processing device 1B in accordance withEmbodiment 5 color-converts a specific color a into a specific color bin an image shown by a first image signal inputted thereto. In thiscase, the first image signal consists of RGB signals, and shows imagedata about an image which is displayed on the display screen of adisplay device (not shown) which the image processing device 1B has, asin the case of above-mentioned Embodiment 1. A second image signal showsimage data about an image in which the specific color a has beencolor-converted into the specific color b in the image shown by thefirst image signal.

The image processing device 1B in accordance with Embodiment 5 isprovided with a specific color specification unit 2 a, a specific colorinformation conversion unit 3, and a color conversion unit 4. Thespecific color specification unit 2 a is a component for specifying aspecific color required for color conversion, and provides a GUI forspecifying a specific color in synchronization with a user's inputoperation using a key operation unit 12 of an input device 11.

The specific color information conversion unit 3 converts data abouteach specific color specified by the specific color specification unit 2a into color conversion information applicable to the color conversionprocess. A method of determining this color conversion information isthe same as that shown in above-mentioned Embodiment 1. The colorconversion unit 4 color-converts the image shown by the first imagesignal by using the color conversion information about the specificcolors determined by the specific color information conversion unit 3 tooutput a second image signal as the color-converted image. A method ofcolor-converting the image is the same as that shown in above-mentionedEmbodiment 1. The input device 11 enables a user to perform an inputoperation on the image processing device 1B, and has the key operationunit 12. For example, a jog dial is disposed in the key operation unit12.

The above-mentioned specific color specification unit 2 a, theabove-mentioned specific color information conversion unit 3, and theabove-mentioned color conversion unit 4 can be implemented as a concretemeans in which software and hardware operate in corporation with eachother by causing a computer to execute an image processing programaccording to the scope of the present invention, and then controllingthe operation of the computer.

Next, the operation of the image processing device will be explained.

(1) In a Case of Using a Color Bar or a Gradation Color Bar

FIG. 9 is a view for explaining a process of specifying a specific colorwhich is carried out by the image processing device shown in FIG. 8. InFIG. 9, the image processing device 1B in accordance with Embodiment 5is embodied by making a processor of a mobile information terminal 13execute the above-mentioned image processing program. This mobileinformation terminal 13 has a display device 14, and a jog dial 12 a asthe key operation unit 12. A mobile phone or a DSC can be provided asthe mobile information terminal 13, though the present invention is notlimited to this example. For example, the mobile information terminalcan be a PDA.

The specific color specification unit 2 a displays an image shown by afirst image signal which is the target for image processing on thedisplay screen of the display device 14 while superimposing a gradationcolor bar 9 shown in FIG. 6 on the image. A user specifies a specificcolor from the gradation color bar 9 on the above-mentioned displayscreen by using the jog dial 12 a.

A mark for specific color specification expressed by a rectangle in FIG.9 is one element of a GUI which is provided for the specification of aspecific color by the specific color specification unit 2 a via thedisplay device 14, and moves on the gradation color bar 9 insynchronization with a movement of the jog dial 12 a. For example, theimage processing device enables the user to move the mark for specificcolor specification in a direction from a left side to a right side onthe gradation color bar 9 by turning the jog dial 12 a clockwise asshown by an arrow in FIG. 9.

The image processing device also enables the user to push down acircular plate portion of the jog dial 12 a in a vertical direction orin a horizontal direction by using the circular plate as a cross key tomove the mark for specific color specification in that direction on thegradation color bar 9. The image processing device further enables theuser to push down the circular plate portion of the jog dial 12 a in adiagonal direction to move the mark for specific color specification ina diagonal direction on the gradation color bar 9.

When a partial area of the gradation color bar 9 is marked, as an areaof each specific color, by the user by using the mark for specific colorspecification in the above-mentioned way, the specific colorspecification unit 2 a acquires RGB data in the above-mentioned partialarea as RGB data about each specific color specified by the user. In theexample shown in FIG. 9, a case in which the user marks, as an area of aspecific color a on which the color conversion is to be performed, anarea (a red area with a color saturation higher than an intermediateone) at a left end and at an upper vertical position of the gradationcolor bar 9 by using the jog dial 12 a, and also marks, as an area of aspecific color b to which the specific color a is to be color-converted,a central area (a blue area with a color saturation higher than anintermediate one) at an upper vertical position of the gradation colorbar 8 is shown.

After acquiring the RGB data about the specific colors a and b from thespecific color specification unit 2 a, the specific color informationconversion unit 3 calculates both a numerical value corresponding to thehue of the specific color a and a numerical value corresponding to thehue of the specific color b from the RGB data about the specific colorsa and b, and outputs these numerical values to the color conversion unit4 as the color conversion information required for the color conversionby the color conversion unit 4. In this case, the specific colorinformation conversion unit calculates a numerical value H correspondingto each of the hues from the RGB ratio of each specific color in the RGBcolor space.

The color conversion unit 4 performs the color conversion on the imageshown by the first image signal according to the color conversioninformation determined by the specific color information conversion unit3, and then outputs a second image signal as the color-converted image.As a result, an image in which the specific color a is color-convertedinto the specific color b in the image shown by the first image signalis generated, and a second image signal is outputted, as thecolor-converted image, to the display device 14.

In the above-mentioned explanation, the case in which the imageprocessing device uses the gradation color bar 9 as a tool used forspecifying a specific color is shown. The image processing device canalternatively use either a color bar 7 as shown in FIG. 4 or a gradationcolor bar 8 as shown in FIG. 5.

(2) In a Case of Using a Gradation Color Circle

FIG. 10 is a view for explaining another example of the process ofspecifying a specific color which is carried out by the image processingdevice shown in FIG. 8. Also in FIG. 10, the image processing device 1Bin accordance with Embodiment 5 is embodied by making a processor of amobile information terminal 13 execute the above-mentioned imageprocessing program, like in the case of FIG. 9. This mobile informationterminal 13 has a display device 14, and a jog dial 12 a as the keyoperation unit 12.

The specific color specification unit 2 a displays an image shown by afirst image signal which is the target for image processing on thedisplay screen of the display device 14 while superimposing thegradation color circle 10 shown in FIG. 7 on the image. A user specifiesa specific color from the gradation color circle 10 on theabove-mentioned display screen by using the jog dial 12 a.

A mark for specific color specification expressed by a rectangle in FIG.10 is one element of a GUI which is provided for the specification of aspecific color by the specific color specification unit 2 a via thedisplay device 14, and moves on the gradation color circle 10 insynchronization with a movement of the jog dial 12 a. For example, theimage processing device enables the user to move the mark for specificcolor specification clockwise on the gradation color circle 10 byturning the jog dial 12 a clockwise as shown by an arrow in FIG. 10.

The image processing device also enables the user to push down acircular plate portion of the jog dial 12 a in a vertical direction orin a horizontal direction by using the circular plate as a cross key tomove the mark for specific color specification in that direction on thegradation color circle 10. The image processing device further enablesthe user to push down the circular plate portion of the jog dial 12 a ina diagonal direction to move the mark for specific color specificationin a diagonal direction on the gradation color circle 10.

In the example shown in FIG. 10, a case in which the user marks, as anarea of a specific color a on which the color conversion is to beperformed, an outer edge area (an area with a maximum color saturation)in which a red color is placed in the gradation color circle 10 by usingthe jog dial 12 a, and also marks, as an area of a specific color b towhich the specific color a is to be color-converted, a middle area (anarea with an intermediate color saturation) in which a blue color isplaced between the center and the outer edge of the gradation colorcircle 10 is shown.

When a partial area of the gradation color circle 10 is marked, as anarea of each specific color, by the user by using the mark for specificcolor specification in the above-mentioned way, the specific colorspecification unit 2 a acquires RGB data in the above-mentioned partialarea as RGB data about each specific color specified by the user. Thesubsequent processes carried out by the specific color informationconversion units 3 and the color conversion unit 4 are the same as thoseas shown in above-mentioned (1).

As mentioned above, the image processing device in accordance with thisEmbodiment 5 includes the key operation units 12, such as the jog dial12 a, which enables the mark for specific color specification to move onthe gradation color bar 9 (the color bar 7, the gradation color bar 8,or the gradation color circle 10) in synchronization with an operation(an input operation). Therefore, the user can easily and visuallyrecognize the hue, brightness, or color saturation of a specific color,and can also select a specific color by performing marking with a simpleinput operation.

In above-mentioned Embodiment 5, the case where the image processingdevice color-converts a specific color a into a specific color b, likein the case of above-mentioned Embodiment 1 is shown. As an alternative,the image processing device in accordance with this Embodiment 5 can beconfigured in such a way as to exclusive-color-convert the color of anyarea other than areas colored in a specific color a specified from thegradation color bar 8 (the color bar 7, the gradation color bar 9, orthe gradation color circle 10) into black or white.

INDUSTRIAL APPLICABILITY

As mentioned above, because the image processing device in accordancewith the present invention can generate a special image at a high speedthrough a simple input operation, the image processing device inaccordance with the present invention is suitable for mobile equipmenthaving a display device, such as a mobile phone or a DSC.

1-12. (canceled)
 13. An image processing device comprising: a specific color specification unit for acquiring, as color component data about first and second specific colors, color component data of at least one set of image areas which are selected from an image, which is a target for processing, by using a mark for specific color specification which is displayed on a display screen in synchronization with an input operation using an input device and which moves on said image which is the target for processing; a specific color information conversion unit for determining values respectively corresponding to hues of said first and second specific colors by respectively specifying color areas in a color space having hue components with ratios of the color component data about said first and second specific colors acquired by said specific color specification unit by using said color component data; and a color conversion unit for color-converting said first specific color in the image which is said target for processing into said second specific color according to the values respectively corresponding to the hues of said first and second specific colors which are determined by said specific color information conversion unit.
 14. The image processing device according to claim 13, characterized in that the specific color specification unit acquires, as each of the color component data about the first and second specific colors, color component data of an image area which is selected from a color bar, which is displayed on the display screen while being superimposed on the image which is the target for processing, by using the mark for specific color specification, the color bar including hues which are arranged in a horizontal direction in a rectangular frame and in order according to a hue circle.
 15. The image processing device according to claim 13, characterized in that the specific color specification unit acquires, as each of the color component data about the first and second specific colors, color component data of an image area which is selected from a gradation color bar, which is displayed on the display screen while being superimposed on the image which is the target for processing, by using the mark for specific color specification, the gradation color bar including hues which are arranged in a horizontal direction in a rectangular frame and in order according to a hue circle with their brightnesses being gradually varied along a vertical direction in said rectangular frame.
 16. The image processing device according to claim 13, characterized in that the specific color specification unit acquires, as each of the color component data about the first and second specific colors, color component data of an image area which is selected from a gradation color bar, which is displayed on the display screen while being superimposed on the image which is the target for processing, by using the mark for specific color specification, the gradation color bar including hues which are arranged in a horizontal direction in a rectangular frame and in order according to a hue circle with their color saturations being gradually varied along a vertical direction in said rectangular frame.
 17. The image processing device according to claim 13, characterized in that the specific color specification unit acquires, as each of the color component data about the first and second specific colors, color component data of an image area which is selected from a gradation color circle, which is displayed on the display screen in synchronization with an input operation using the input device while being superimposed on the image which is the target for processing, by using the mark for specific color specification, the gradation color circle including hues which are arranged in a form of a circle in a circular frame and in order according to a hue circle with their color saturations being gradually varied along a direction from a center of said circular frame toward an outer edge of said circular frame.
 18. The image processing device according to claim 13, characterized in that the image processing device includes the input device for enabling the mark for specific color specification to move according to an input operation on the input device.
 19. An image processing device comprising: a specific color specification unit for acquiring, as color component data about a specific color, color component data of at least one image area which is selected from an image, which is a target for processing, by using a mark for specific color specification which is displayed on a display screen in synchronization with an input operation using an input device and which moves on said image which is the target for processing; a specific color information conversion unit for determining a value corresponding to a hue of said specific color by specifying a color area in a color space having hue components with a ratio of the color component data about said specific color acquired by said specific color specification unit by using said color component data; and a color conversion unit for color-converting any color other than said specific color in the image which is said target for processing to black or while according to the value corresponding to the hue of said specific color which is determined by said specific color information conversion unit.
 20. The image processing device according to claim 19, characterized in that the specific color specification unit acquires, as the color component data about the specific color, color component data of an image area which is selected from a color bar, which is displayed on the display screen while being superimposed on the image which is the target for processing, by using the mark for specific color specification, the color bar including hues which are arranged in a horizontal direction in a rectangular frame and in order according to a hue circle.
 21. The image processing device according to claim 19, characterized in that the specific color specification unit acquires, as the color component data about the specific color, color component data of an image area which is selected from a gradation color bar, which is displayed on the display screen while being superimposed on the image which is the target for processing, by using the mark for specific color specification, the gradation color bar including hues which are arranged in a horizontal direction in a rectangular frame and in order according to a hue circle with their brightnesses being gradually varied along a vertical direction in said rectangular frame.
 22. The image processing device according to claim 19, characterized in that the specific color specification unit acquires, as the color component data about the specific color, color component data of an image area which is selected from a gradation color bar, which is displayed on the display screen while being superimposed on the image which is the target for processing, by using the mark for specific color specification, the gradation color bar including hues which are arranged in a horizontal direction in a rectangular frame and in order according to a hue circle with their color saturations being gradually varied along a vertical direction in said rectangular frame.
 23. The image processing device according to claim 19, characterized in that the specific color specification unit acquires, as the color component data about the specific color, color component data of an image area which is selected from a gradation color circle, which is displayed on the display screen in synchronization with an input operation using the input device while being superimposed on the image which is the target for processing, by using the mark for specific color specification, the gradation color circle including hues which are arranged in a form of a circle in a circular frame and in order according to a hue circle with their color saturations being gradually varied along a direction from a center of said circular frame toward an outer edge of said circular frame.
 24. The image processing device according to claim 19, characterized in that the image processing device includes the input device for enabling the mark for specific color specification to move according to an input operation on the input device. 